Apache Scala Course Content

Module-1: Introduction to Spark and Analysis

• Why second-generation frameworks?
• Introduction to Spark
• Scala shell
• Spark Architecture
• Spark on Cluster
• Spark Core
• SparkSQL
• Spark Streaming
• Cluster Managers
• Spark Users
• What is use of Spark
• Spark Versions
• Spark Storage Layers
• Download Spark

1. Spark API on a Cluster

• A. Why second-generation frameworks?
• B. The Driver
• C. Executors
• D. Execution components: jobs, tasks, stages
• E. Spark Web UI

2. Cluster Manager

• A. Standalone Cluster Manager
• B. Hadoop YARN
• C. Apache Mesos
• D. Amazon EC2
• E. Which Cluster Manager?
• F. Spark-submit for deploying applications
• G. Using MAVEN for JAVA SPARK application
• H. Using SBT for A SCALA Application

Module-2: DATALOADING (HDFS, Amazon s3)

• Different file formats:
• Text files
• Json
• Comma, tab separated values
• Object files
• Sequence files
• Input /output formats
• SPARKSQL for Structured data

Module-3: RDD’S

• What is RDD
• Why RDD?
• RDD operations
• Transformations
• Actions
• Lazy Evaluation
• Basic RDD’s
• Caching
• Converting between RDD types
• Spark Api supports Python, Java, Scala
• Working with Key, value pairs
• Create key, value pair RDD’s

1. Transformations on pair RDD’s

• Aggregations
• Grouping data
• Joins
• Sorting data

2. Actions on pair RDD’s

• RDD’s partitioner
• Operations from partitioning
• Page Rank example

3. Advanced Spark operation

• Aggregate
• Fold
• Map partitions
• Glom
• Accumulators
• Broadcasters
• Anatomy of a spark RDD
• Splits
• Localization
• Serialization
• Transformations Vs. Actions

Module-4: SPARK SQL

• Spark sql in applications
• Spark sql initialization
• Spark sql basic query
• Schema RDD’s
• Caching
• Load data from hive
• Load data from json
• Load data from RDD’s
• Beeline
• Long-lived tables and queries
• Query hands-on
• Spark sql UDF’s
• Performance

Module-5: SPARK STREAMING

• Streaming Architecture
• Two types of Transformations
•    1. Stateless Transformations
•    2. Stateful Transformations
• Streaming UI
• Sources: Input
• Core Sources
• Additional Sources
• Multiple Sources
• Cluster Sizing

Fault Tolerance

• Driver Fault Tolerance
• Worker Fault Tolerance
• Receiver Fault Tolerance
• Operation 24/7
• Performance
• Garbage collection
• Memory Usage

FAQ’S

What if I miss one (or) more class?

No need to worry about the classes you missed. We will definitely guide you by having optional classes or by having classes with other batches with the same topic you missed previous classes.

Who is my instructor?

IT professionals who have strong knowledge in technical know how to convey things with the real-time example. Even a layman could understand the concepts which given by our experts.

What are the modes of training offered for this course?

We offer this course in “Live Instructor-Led Online Training” mode. Through this way you won’t mess anything in your real-life schedule. You will be shared with live meeting access while your session starts.

What are the system requirements to work?

Minimum 2GB RAM and i3 processor is required

Can I attend a demo session?

You can get a sample class recording to ensure you are in right place. We ensure you will be getting complete worth of your money by assigning a best instructor in that technology.

How about group discounts (or) corporate training for our team?

We are absolutely loved to talk in-person about group training (or) corporate training. So, please get in touch with our team through “Quick Enquiry”, “Live Chat” or “Request Call-back” channels.

Where do Our Online learners and Trainer’s come from

We are providing online training, One-to-One training with the help of experts. Our learners and trainers are frequently coming from different countries like USA, India, UK, Australia, New Zealand, Canada and UAE. To specify in cities London, Bangalore, California, New York, Pune, Mumbai, Chennai, New Delhi, San Francisco, New Jersey, Texas, Florida, Kolkata, Gurgaon, Berlin and Hyderabad among many.

I have more queries?

If you want to know More Details about Online Training Please Contact us. Or you can share your quires through info@monstercourses.com. Estimated turnaround time will be 24 hours for mails.

Contact us