Spark
72 videos • 19,593 views • by SparklingFuture
Spark with Scala - Coding Interview questions
1
Handling corrupted records in a JSON | Spark SQL with Scala | Databricks
SparklingFuture
Download
2
Reading a JSON file in RDD | Spark with Scala | JSON4S
SparklingFuture
Download
3
Partitions | map vs mapPartition Vs MapPartitionWithIndex | Spark with Scala
SparklingFuture
Download
4
Applying Header Dynamically to a Dataframe | Spark With Scala | With example
SparklingFuture
Download
5
Spark Shuffle Operations | Spark with Scala | reduceByKey Vs groupBykey
SparklingFuture
Download
6
AggregateByKey | Spark with Scala| Shuffle Operations - Part3
SparklingFuture
Download
7
CombineByKey | Spark with Scala | Shuffle Operation - Part 4
SparklingFuture
Download
8
reduceByKey Vs GroupByKey Vs foldByKey Vs aggregateByKey Vs combineByKey | Spark with Scala | part-5
SparklingFuture
Download
9
sortByKey | Spark with Scala| Shuffle Operation - Part - 6
SparklingFuture
Download
10
Spark Joins | Spark Shuffle operations - Part - 7| Spark with Scala
SparklingFuture
Download
11
CoGroup Vs Join | Shuffle Operations - Part 8 | Spark with Scala
SparklingFuture
Download
12
Distinct Vs DropDuplicates | Shuffle Operations - Part9 | Spark with Scala
SparklingFuture
Download
13
Explode | Explode_Outer| Posexplode | Posexplode_outer| Spark with Scala| With Coding
SparklingFuture
Download
14
Reading XML file as a DataFrame in Spark SQL with Scala | Databricks XML package
SparklingFuture
Download
15
Writing a Dataframe as XML format in Spark SQL Using Scala | Databricks XML package
SparklingFuture
Download
16
Reading Parquet File as a DataFrame | Spark with Scala | Applying filter transformation
SparklingFuture
Download
17
Writing a DataFrame into Parquet File | Spark with Scala | Coding Interview Questions
SparklingFuture
Download
18
Reading a Nested XML as a DataFrame | Spark SQL with Scala| Scenario Based Question
SparklingFuture
Download
19
Reading Avro File as a DataFrame | Spark SQL with Scala | Spark Scenario Based Question
SparklingFuture
Download
20
Reading/ Writing AVRO File format in Spark using Scala | Hive Table Creation from Spark
SparklingFuture
Download
21
Schema Merge | Schema Evolution | Parquet| Spark with Scala | Scenario based questions
SparklingFuture
Download
22
Finding Highest Salary of an Employee using Spark with Scala | Window functions | rank | dense_rank
SparklingFuture
Download
23
Coalesce in Spark SQL | Scala | Spark Scenario based question
SparklingFuture
Download
24
Creating Hive table from Spark using Scala | Scenario based question | Hive Catalog function
SparklingFuture
Download
25
Dealing Multi source CSV file in Spark SQL | json_tuple | CSV & JSON in a single file | using Scala
SparklingFuture
Download
26
Using toJSON and from_json in Spark with Scala | Scenario based question
SparklingFuture
Download
27
Date Functions in Spark SQL with Scala | Spark coding interview questions
SparklingFuture
Download
28
map vs flatMap vs mapValues vs flatMapValues | Spark with Scala | Coding Interview questions
SparklingFuture
Download
29
Resolving winutils.exe binary and (null) entry in command string: null Exceptions | Spark with Scala
SparklingFuture
Download
30
UnionByName | Combining 2 DataFrames | Spark with Scala
SparklingFuture
Download
31
Broadcast variables usage in Spark with Scala | Spark Interview Question | performance Management
SparklingFuture
Download
32
Cache Vs Persist in Spark with Scala - Part 1 | Spark Interview Questions
SparklingFuture
Download
33
Storage Levels while persisting in Spark - Part 2 | Spark with Scala | Optimization techniques
SparklingFuture
Download
34
UDF creation and usage in Spark SQL | DataFrame | Spark with Scala
SparklingFuture
Download
35
Deploying Spark Application in the cluster through Shell Script - Part 1 | spark-submit
SparklingFuture
Download
36
Finding no. of occurrences of a hashtag in a tweets | Spark with Scala | Coding interview question
SparklingFuture
Download
37
RDD Transformations in Spark with Scala - Part 1 | Spark Coding Interview questions
SparklingFuture
Download
38
RDD Transformations - part 2 | Spark with Scala | Spark Technical Interview questions
SparklingFuture
Download
39
RDD Transformations - part 3 | Spark with Scala | Technical Interview questions
SparklingFuture
Download
40
RDD Transformations - part 4 | Spark with Scala | Technical Interview questions
SparklingFuture
Download
41
RDD Transformations - part 5 | Spark with Scala | Technical Interview questions
SparklingFuture
Download
42
RDD Transformations - part 6 | Spark with Scala | Technical Interview questions
SparklingFuture
Download
43
Working with Array[Array[Int]] in RDD | RDD Transformations - Part 7 | Spark with Scala
SparklingFuture
Download
44
Working with LIST(Array) in RDD | RDD Transformations Part-8 | Spark with Scala
SparklingFuture
Download
45
Regexp_replace and ReplaceAll in Spark SQL using Scala | Replacing multiple delimiters at a time
SparklingFuture
Download
46
Using Pivot() in Spark SQL with Scala | Scenario based question
SparklingFuture
Download
47
Converting DataFrame columns as a single String in Spark SQL with Scala | Scenario based question
SparklingFuture
Download
48
Adding Columns Dynamically to a DataFrame in Spark SQL using Scala
SparklingFuture
Download
49
FoldLeft() | Replacing all the Column names at one go dynamically in a DF in Spark SQL using Scala
SparklingFuture
Download
50
Resolving ERROR SparkUI: Failed to bind SparkUI java.net.BindException in Spark with Scala
SparklingFuture
Download
51
Splitting Columns into multiple columns in a DF | Spark with Scala| Dealing with Multiple delimiters
SparklingFuture
Download
52
Skipping lines in a Header by adding unique Id | Spark with Scala | monotonically_increasing_id
SparklingFuture
Download
53
Converting ScalaMap to individual columns in a DF | SparkSQL & Scala | Spark Scenario based question
SparklingFuture
Download
54
Spark Structured Streaming using Scala | Streaming files from a folder
SparklingFuture
Download
55
Spark Structured Streaming with Kafka using Scala
SparklingFuture
Download
56
When-Otherwise | Case When end | Spark with Scala | Scenario-based questions
SparklingFuture
Download
57
Joining 3 or more tables in Spark Dataframe API using Scala | Scenario-based questions | Part -1
SparklingFuture
Download
58
Joining 3 or more tables using Spark SQL queries with Scala | Scenario-based questions | Part -2
SparklingFuture
Download
59
Pairing Array elements which equals to the given SUM value |Spark with Scala |Reading irregular data
SparklingFuture
Download
60
Unifying Different Date formats Dynamically in Spark with Scala | DataFrame | foldLeft
SparklingFuture
Download
61
Working with Unix Timestamp (EPOCH) in Spark SQL with Scala
SparklingFuture
Download
62
Reading XML data from a CSV file in Spark SQL with Scala | MultiSource Data - CSV & XML
SparklingFuture
Download
63
Hadoop Vs Spark | Mapreduce Vs Spark | Spark Interview Questions
SparklingFuture
Download
64
Hive Operations through Spark with Scala
SparklingFuture
Download
65
MSCK Repair for recovering the Hive Partitions | Spark with Hive | Spark Interview Questions
SparklingFuture
Download
66
Joining RDDs in Spark| Types of Joins available for RDD | Spark Interview Questions
SparklingFuture
Download
67
Catalyst Optimizer in Spark SQL| Checking the various plans in Eclipse | Spark Interview Questions
SparklingFuture
Download
68
Spark memory allocation and reading large files| Spark Interview Questions
SparklingFuture
Download
69
(Re-upload) What is Shuffle | How to minimize shuffle in Spark | Spark Interview Questions
SparklingFuture
Download
70
Reading Semi-Structured data | Spark with Scala | Realtime scenario
SparklingFuture
Download
71
Comparing Lists in Scala | Spark Interview Questions | Realtime scenario
SparklingFuture
Download
72
Thank you Friends | 1000 Subscribers | Sparkling Future | A Number to Remember :)
SparklingFuture
Download