Course: B.Tech (Semester V)
Subject Code: KDS053
Subject: Stream Processing and Analytics
Maximum Marks: 100
Time: 3 Hours
Structure:
Section A: 10 short questions × 2 marks = 20 marks
Section B: Attempt any 3 × 10 marks = 30 marks
Section C (Q3–Q7): Each with 2 alternatives × 10 marks = 50 marks
SECTION A – Short Answer Questions (2 × 10 = 20 Marks)
a. What is scaling?
b. What is meant by Windows Aggregation?
c. What is meant by Batch Processing?
d. What is meant by Data Analysis?
e. Explain the Distributed System.
f. What is meant by Data Server?
g. Define IoT (Internet of Things).
h. What is meant by Structured Streaming?
i. What is meant by Time-based Stream Processing?
j. Discuss Spark Streaming Context.
SECTION B – Analytical / Programming Questions (Any 3 × 10 = 30 Marks)
a. Differentiate between Stateless and Stateful Processing with examples.
b. Write a simple Spark program that prints a sample of tweets received from Twitter every second.
Define: What is a Socket?
c. Write a script in Spark to read all text files into Spark RDD.
Define Spark Components.
d. Discuss Structured Streaming Sinks.
Define Trigger and Latency.
e. Compare Structured Streaming vs Spark Streaming.
SECTION C – Long/Descriptive Questions (Each 10 Marks)
Q3. Performance and Components
a. Write short notes on:
i. Performance Tuning
ii. Time-based Streaming Process
b. What are the components of Spark Streaming?
Define DStreams (Discretized Streams).
Q4. Stream Models and Basics
a. Discuss Sources and Sinks Stream Processing Model.
b. What is Apache Spark? Explain Stream Processing.
Q5. Batch Processing and Metrics
a. Discuss Batch Processing Component in a Streaming Application.
b. Write short notes on:
i. Latency
ii. Throughput
Q6. Spark’s Resilience and Cluster Concepts
a. Discuss Spark’s Resilience Model and explain the use of SparkContext.parallelize() method.
b. Write short notes on:
i. Cluster Manager
ii. Fault Tolerance in Distributed Systems
Q7. Structured Streaming and Data Acquisition
a. Write short notes on:
i. Features of Structured Streaming
ii. Stream Execution
b. How to acquire streaming data from sources?
What is a Streaming Dataset?