(SEM V) THEORY EXAMINATION 2023-24 STREAM PROCESSING AND ANALYTICS

Course: B.Tech (Semester V)

Subject Code: KDS053

Subject: Stream Processing and Analytics

Maximum Marks: 100

Time: 3 Hours

Structure:

Section A: 10 short questions × 2 marks = 20 marks

Section B: Attempt any 3 × 10 marks = 30 marks

Section C (Q3–Q7): Each with 2 alternatives × 10 marks = 50 marks

SECTION A – Short Answer Questions (2 × 10 = 20 Marks)

a. What is scaling?
b. What is meant by Windows Aggregation?
c. What is meant by Batch Processing?
d. What is meant by Data Analysis?
e. Explain the Distributed System.
f. What is meant by Data Server?
g. Define IoT (Internet of Things).
h. What is meant by Structured Streaming?
i. What is meant by Time-based Stream Processing?
j. Discuss Spark Streaming Context.

SECTION B – Analytical / Programming Questions (Any 3 × 10 = 30 Marks)

a. Differentiate between Stateless and Stateful Processing with examples.
b. Write a simple Spark program that prints a sample of tweets received from Twitter every second.

Define: What is a Socket?
c. Write a script in Spark to read all text files into Spark RDD.

Define Spark Components.
d. Discuss Structured Streaming Sinks.

Define Trigger and Latency.
e. Compare Structured Streaming vs Spark Streaming.

SECTION C – Long/Descriptive Questions (Each 10 Marks)

Q3. Performance and Components

a. Write short notes on:
i. Performance Tuning
ii. Time-based Streaming Process

b. What are the components of Spark Streaming?

Define DStreams (Discretized Streams).

Q4. Stream Models and Basics

a. Discuss Sources and Sinks Stream Processing Model.
b. What is Apache Spark? Explain Stream Processing.

Q5. Batch Processing and Metrics

a. Discuss Batch Processing Component in a Streaming Application.
b. Write short notes on:
i. Latency
ii. Throughput

Q6. Spark’s Resilience and Cluster Concepts

a. Discuss Spark’s Resilience Model and explain the use of SparkContext.parallelize() method.
b. Write short notes on:
i. Cluster Manager
ii. Fault Tolerance in Distributed Systems

Q7. Structured Streaming and Data Acquisition

a. Write short notes on:
i. Features of Structured Streaming
ii. Stream Execution

b. How to acquire streaming data from sources?

What is a Streaming Dataset?